Scaling law

In many systems there exist scaling laws between the characteristic measures of the system.

Dimensional analysis

Urban scaling is about the scaling relationships between population and various measures. For instance, the innovation-related measures have super-linear scaling whereas other measures like energy usage (?) scale sub-linearly. A good analogy to Allometric scaling, the scaling relationship describing living organisms (e.g., the body size and metabolic rate).

Kaplan2020scaling shows that there exists scaling laws between test loss and the size of compute/model/data.


Power law < > Allometric scaling | Urban scaling